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(54) Tide: FOG SIMULATION FOR PARTIALLY TRANSPARENT OBJECTS 
(57) Abstract 

A method for siniulating fog in 3D graphics rendering applications correctly computes fogged pixel colors even in graphics scenes 
where two surfaces overlap and the frontmost surface is partially transparent. The method computes the fog for each surface according to 
the following fonmula: fp atop A, where /is the amount of fog, F is the color of the fog, and A is the color of the pixel being fogged. Each 
fogged surface can be rendered independently to a separate image layer, called a fogged image layer. The graphics rendering system can 
then simulate the motion of a fogged image layer by moving the fogged layer in an (x.y) plane without re-computing the fogged pixels, or 
by moving die fogged layer in the z-direction and independently re-computing the moving fogged layer with a new value for the amount 
of fog applied to the image layer. The method applies to scenes where there arc several fogged layers and to scenes that simulate fiie and 
glow with pixels tiiat are totally transparent but have non-zero color values. 
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FOG SIMULATION FOR PARTIALLY TRANSPARENT OBJECTS 



The invention relates to a technique used in three-dimensional (3D) graphics 
rendering to simulate fog: 



In 3D graphics rendering, fog simulation is a rendering technique that can be 
used to simulate atmospheric effects such as haze, fog and smog. Fog is a general 
term that encompasses a variety of atmospheric effects such as haze, mist, smoke or 
pollution. Some computer-generated images tend to appear imrealistically sharp and 
well defined. Fog can make a computer-generated image more natural by making 
objects fade into the distance. When fog is simulated in a graphics scene, the objects 
that are farther from the viewpoint start to fade into the color of the fog. 

In conventional graphics rendering architectures, like OpenGL, the author of 
a graphics scene can control the density of the fog as well as the fog color. The 
density of the fog is corifrolled by a parameter called the fog blend factor or fog 
dissolve factor, f. The fog color is typieaily represented as a Vector value such as 
F=[^red> ^grecn> ^biuc* The color F is expressed in conventional vector algebraic 
notation, including four components: red, green, blue and alpha. Alpha is the 
opacity of the pixel, and typically ranges from 0 (totally transparent) to 1 (totally 
opaque). Note that the alpha value of the fog is set to 1 , which means that the fog is 
simulated as being totally opaque. The extent to which an object appears to fade 
into the fog depends on the fog factor, and specifically, how much fog exists 
between the viewpoint and the object. Both the fog color and the fog factor are 
terms in a fog model used to compute the value of a fogged pixel given the color and 
opacity of an input pixel, such as A=[ A^^, A^^^, Aa] . 

The fog factor,/, represents an amount of fog. One way to describe the 
amount of fog at a given location in a graphics scene is to defme it as the fog 
influence between the vie^ypoint of the graphics scene and the depth of an object 
relative to the viewpoint. More specifically, the fog factor is typically calculated as 



FIELB OF THE INVENTION 



BACKGROUND OF THE INVENTION 
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a function of z, the depth of an object from the viewpoint. For exainple one 
expression for/is: 



/=l-e 
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where x is the optical depth and Za is the depth of the object from the 
viewpoint. The value of/can be computed by a variety of other functions in the 
OpenGL graphics programming language from Silicon Graphics, and the DirectSD 
graphics programming interface from Microsoft. It is important to note that the 
notation for the dissolve factor is slightly different in some graphics programming 
languages. For example, in OpenGL, the value of/in the above equation actually 
corresponds to (l-f) in OpenGL rotation. 

Figure 1 is a block diagram illustrating how fog is typically applied to pixels 
in a conventional 3D graphics rendering pipeline. The rasterizer 20 is a stage in the 
graphics rendering pipeline where a georiieitric priniitive used to model the surface of 
an object is converted into pbcel values. In a geometric processing stage, the objects 
in a scene are clipped to a view volume and geonietrically transformed to a view 
space, corresponding to a display screen. The rasterizer 20 takes the transformed 
geometric primitives (e.g., polygons) as input and computes the color of each pixel 
within the polygon. Typically, conventional rast^rizers interpolate color values at a 
polygon's vertices to compute the color values at a pixel location within the 
polygon. The fog applicator 22 then modifies the color values of a pixel by applying 
an amount of fog of a predetermined color to interpolated color values. The blend 
unit 24 is responsible for blending pixels from the rasterizer and fog applicator with 
pixel values at corresponding pixel locations in the frame buffer 26. The frame 
buffer is memory that stores an array of pixel values corresponding to the picture 
elements in a display device. When the graphics rendering pipeline completes the 
rendering of a graphics scene, the frame birffer has an array of pixels representing an 
output image for display on a display screen. 

During rendering, the rasterizer 20 processes a stream of geometric 
primitives from the objects in a graphics scene. In some cases, geometric primitives 
can overlap the same pixel location. For example, a graphical object representing a 
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foreground object can have polygons that occlude polygons of a background object. 
Graphics rendering systems employ a method called hidden surface removal to 
determine which surfaces are actually visible in a scene. One technique for hidden 
surface removal is to rasterize unsorted polygons into pixels with depth values, the 
5 blend unit 24 then determines whether an input pixel generated by the rasterizer 
occludes a previously generated pixel in the frame buffer at the same pixel location. 
If it does, the blend unit 24 replaces the pixel in the frame buffer with the new pixel. 
If it does not, the blend unit 24 discards the new pixel. An alternative technique is to 
sort the polygons in depth order and rasterize them in front to back order. 

1 0 The process of computing pixel values in the frame buffer gets more 

complicated for partially ^ansparent pixels since it is often necessary to combine the 
frontmost opaque pixel with partially transparent pixels in front of it. In some 
architectures that support partially transparent pixels, the blend unit 24 includes 
logic to combine partially transparent pixel values (sometimes called pixel 

1 5 fragments) at a pixel location into a final output pixel. Some architectures also 
rasterize geometric primitives at a subpbcel resolution and then blend the pixel 
values of the subpixels in the neighborhood of each pixel location to compute final 
pixel values at each pixel location. 

As illustrated in Fig. 1, the fog applicator 22 receives input pixels from the 

20 rasterizer and modifies them to simulate fog. The maimer in which the fog 

applicator modifies a pixel (or pixel fragment) to simulate fog depends on the fog 
model or models implemented iii it. 

The conventional model for fogging a pixel A by the anidunt/of fog color F 

is: 

25 yF + (l-y)A, 

where A is the color of the pixel being fogged. 

The conventional formula for fog sirhulation will generate the wrong pixel 
color if two fogged surfaces overlap on the screen and the frontmost surface is 
partially transparent. A fogged surface refers to a rendering of the surface of a 3D 
30 object into pixel values where the pixel values are modified due to the influence of 
fog on the object's surfece. 
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There are two primary cases where a surface is partially transparent: i) 
some of the geometric primitives ( e.g., polygons) used to model the surface of an 
object may only partially cover a pixel location in screen space; and 2) some of the 
geometric primitives used to model the surface of an obj ect may be translucent. In 
5 both cases, the pixels generated by the fasterizer inight have an opacity value (alpha) 
indicating that the pixel is not opaque. 

The best way to illustrate the problem with the conventional approach in 
these cases is to consider an example. Figure 2 is a diagram illustrating how the 
conventional fog model produces incorrect results when the two fogged pixels are 

10 combined. Fig. 2 shows series of magnified square regions representing pixels A 
and B. The pixels are the points at the center of each square, and the square regions 
are at ±1/2 pixel spacing from the pixels. Pixels A and B each have a partially 
covered region (hatched regions 40 and 42) and transparent regions (white areas 44 
and 46. Assume in this example that pixel A is closer to the viewpoint than B (z^ < 

15 Ze). 

The fog is represented as a scattering of dots (e.g., 48) of color F and an 
amount f(z) corresponding to the fog between the viewpoint and the depth value (z) 
of the pixel . 

Using the conventional formula, the fogged pixels A and B (50, 52) appear 
20 as shown in Fig. 2. When the two fogged pixels are composited, the result looks like 
the square region 54. The result of the compositing operation gives the wrong result 
because a portion of the fog is counted twice. In Fig. 2, this problem is illustrated in 
the upper left region 56 of the square 54, where the fog appears denser because a 
portion of the fog at this region is counted twice. If A and B are composited over a 
25 fog background, the final pixel at this location will not be correct because the pixel 
will have too much fog color. If A and B are composited over another object (e.g., 
opaque pixel C), the final image will not be correct at this location because the 
object will receive too much fog color. 

In view of this problem with the conventional fog model, there is a heed for 
30 an improved fog model that accurately simulates fog when applied to scenes with 
partially transparent objects. 
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A number of special effects can be achieved by blending or modifying pixel 
values using image operators. See Porter and Duff, Compositing Digital Images, 
Computer Graphics, Vol.18, No. 3, at 253-259, July 1984. In this paper, Porter and 
Duff defined a series of image operators that can be used to combine pixels to 
5 compute a composite image. The image operators in this paper are suihmarized in 
the following table, which describes how images A and B can be combined in terms 
of the fractions of A and B present in the final, composite image: 



operation 


At 


B, 


clear 


0 


0 


A 


1 


0 


B 


0 


1 


A over B 


1 


\'Aa 


B over A 




1 


Ain B 




0 


B in A 


0 


A. 


AoutB 




0 


Boiit A 


0 


l-Aa 


A atop B 


Ba 




B atop A 


l-Ba 


Aa 


AxorB 


UB^ 




A plus B 


1 


1 



Af and represent the fractions of the respective input images that are 
present in the final, composite iinage. As Porter and Duff describe, the color 
component of pixels iri the composite iinage can be expressed as: 
A^A^A^ + 5p where A^ and 3^ are the color components of image A and 
image B (Ac =[ A,^, A^, and Be =[ 5«d, B^^, 5^, J ). 

The Porter and Duff operators also include "unary" operators performed on a 
single image: 

darken (A, (|)) = ((M^ (t>^t,, 

dissolve (A, 8) = (5^^ 8^^, 5^g, 8 ^o). 

The "over" operator can be used to combine partially transparent pixels into 
an ou^ut pixel. However, the use of the over operator does not solve the problem 
associated wdth fog applied to partially transparent objects. Porter and Duff do not 
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address the problem of simulating fog, and more specifically, the problem of 
simxdating fog of paurtially transparent objects. 

SUMMARY OF THE INVENTION 

5 The invention provides an improved method and fog simulator logic for 

accurately simulated fog for partially transparent objects that overlap other objects in 
graphics scenes. In contrast to conventional fog simulation, the fog simulation 
method uses the "atop" operator to fog pixels as follows: atop A; 

where/is the amount of fog, F is the fog color, and A is the color of the 
1 0 pixel being fogged. The logic for simulating fog can be expressed as: 
/4aF + (l-y)A; 

where A a is the alpha value for pixel A. 

Unlike the conventional method for simulating fog, this method will obtain 
the correct result even when a partially transparent object is in firont of a back^ound 

1 5 object The foregroimd object may be partially transparent because it has translucent 
portions or as a result of anti-aliasing computations^ 

In a graphics rendering system, this fog method is applied after computing 
the color of the pixel being fogged. The fogged pixel can then be composited with 
another pixel at the same location. This method applies particularly well to a 

20 layered graphics rendering pipeline where geometry in a graphicis scene is rendered 
to separate image layers called sprites. A fogged image layer can be stored and re- 
used as long as the object rendered to the image layer moves in an (x,y) plane. If an 
object moves in the z direction, then it can be re-rendered independently and fogged 
using a new amount of fog representing the fog between the viewpoint and the 

25 object. 

Additional features and advantages of the invention will become more 
appisu^nt from the following detailed description and the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 Fig. 1 is a block diagram illustrating how fog is typically applied to pixels in 

a conventional 3D graphics rendering pipeline. 
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Fig. 2 is a diagram of two partially covered pixels illustrating the problem of 
the conventional fog simulation formula in combining partially transparent pixels. 

Fig. 3 is a diagram graphically illustrating logic used to apply fog to pixels 
using ah improved fog model that accurately simulates fog for partially transparent 
surfaces that overlap other fogged surfaces. 

Fig. 4 is a diagram illustrating how the fog logic shown in Fig. 3 solves the 
problem that occurs when a partially transparent surface overlaps another surface. 

Fig. 5 illustrates an example of a scene with two overlappirig objects A and B 
and the surrounding fog represented in fog layers. 

Fig. 6 illustrates an example of a scene with several overlapping objects and 
fog to illustrate how the atop operator can be used to independently compute fog for 
object layers. 

Fig. 7 is a block diagiram illustrating an example of a computing environment 
in which a software rendering system can be implemented. 

Fig. 8 is a block diagram illustrating an implementation of a layered graphics 
rendering system. 

DETAILED DESCRIPTION 

Introduction 

As introduced in the background section, the conventional technique for 
simulating fog generates an incorrect result when two partially transparent surfaces 
overlap on the screen. A more accurate approach for simulated fog can be expressed 



by the following formula for fogging a pixel A by the amount/of fog color F: 
yFatopAs/4aF + (l-y)A, 



color applied to the pixel by the degree to which the pfacel is partially transparent, or 
in other words, by the pixel's alpha value, Aa^ One significant advantage of this 
approach is that it enables partially transparent surfaces to be fogged independently 
and then composited to compute an image that accxirately simulates fog. 



where A is the color of the pixel being fogged. 

This fog model differs from the conventionsd model in that it reduces fog 
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The "atop" operator refers to an image compositing operator described in 
Porter and Duff. The atop operator gives the portion of the &st termyF that 
overlaps the second term A, in union with the portiori of the second term A outside 
of the first term. Imagine the first term as a table cloth and the second term as a 
table. The expression table cloth atop table mcludes table cloth where it is on top of 
the table, and the table; otherwise, the area beyond the edge of the table is out of the 
picture. Thus, if A is partially transparent, it only receives fog on its non-transparent 
portion. The color values of the pixel A are expressed as: 
A=I A^, ^biuc» -^J. The alpha of the pixel defines the extent to which it is 
partially transparent, and is typically a number between 0 and 1, inclusive (or 0 to 
255 in an 8 bit binary number). The alpha can represent the translucency of the pixel 
or the extent to which an opaque pixel is covered by a polygon as a result of 
antialiasing computations. 

The color values of the fog F are expressed as: 

1]. The amount of fog /is the amount of fog in firont of the pixel 
A (between the viewpoint and the depth of the pixel, z). The value of /in this 
notation ranges firdm 0 at the viewpoint to 1 at a point infmitely far firom the 
viewpoint. 

It is important to emphasize that some graphics rendering systems use a 
slightly different notation for the amount of fog. In OpenGL, for example, the 
amount of fog between the viewpoint and a pixel location on the surface of a 
polygon is (1-^, instead of/as used above. 

The Fog Simulator 

The approach for simulating fog summarized above can be incorporated into 
3D graphics rendering systems implemented in software, hardware or a combination 
of both. Regardless of the implementation details of the rendering pipeline, the pixel 
processing operations for simulating fog based on the fog model above is 
substantially the same in both hardware and software platforms. Fig. 3 is a diagram 
graphically illustrating the logic used to apply fog to pixels based on the formula 
described in the introduction section. 
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In Fig. 3, the mathematical operators of the fog model are functional units in 
the fog logic. Note that there are many ways to express the fog model using 
different operators that achieve the same result. The logic shown in Fig. 3 is just one 
example to show how fog can be applied to a pixel using the atop operator. 

The fog logic in this example includes three multipliers 100, 102 and 104 
and an adder 106. The first multiplier 100 multiplies the fog amount/and the alpha 
of the pixel generated by the rasterizer. The second multiplier 1 02 takes this 
intermediate result (fA^) and multiplies it by the fog colors. The second multiplier 
is a vector multiplier that multiplies the color components of F by the scalar quantity 

(Ma). 

The third multiplier 104 is alsq a vector multiplier that multiplies the color 
valuesof A by the scalar quantity (1-y) to generate another interm^^^^ The 
adder 1 06 is a vector adder that combines the scaled color values from the vector 
multipliers 102 aiid 104. The result is a fogged pixel, fogged A. 

The fogged pixel can be composited with fogged pixels from other surfaces 
at the same pixel location and produce the correct result even if the other surfaces 
are partially transparent at the pixel location. Specifically, fogged pixels from 
different surfaces can be combined in back-to^front order using the over operator. A 
description of how to combine fogged pixels for more complex geometry is 
explained further below. 

The logic for simulating fog solves the problem associated with fogging 
partially transparent surfaces that overlap other fogged surfaces. To illustrate this 
point, it is helpful to consider an example showing how the logic computes a fogged 
pixel using the fog logic shown in Fig. 3. Fig. 4 is a diagram illustrating how the 
fog logic shown in Fig. 3 solves the problem that occurs when a partially transparent 
surface overlaps another isurface. Fig. 4 is similar to Fig. 2 described in the 
background section hi that it shows a series of diagrams of the same pixels A and B, 
However, it differs in that the surfaces A and B are fogged using the atop operator, 
instead of the conventional fog expression. 

As in Fig. 2, region A and region B have opaque portions 40 and 42, and 
transparent portions 44 and 46, Each of these regions can represent either a partially 
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covered opaque pixel (such as a pixel fragment produced as a result of antialiasing) 
or a translucent pixel (from a translucent surface that allows light reflected from a 
background surface to pass through). A translucent pixel is represented 
geometrically as partially covered region where the size of the covered region is 
proportional to the alpha of the pixel. 

The second row depicts regions A and B (regions 120 and 122) fogged using 
the atop operator to apply an amount of fog of color F to regions A and B. The 
amount of fog is the portion of fog between the viewpoint and each surface. For 
example, the amount of fog applied to region A is the fog between the viewpoint and 

A, and the amount of fog applied to region B is the fog between the viewpoint and 

B. When the fogged pixels are combined using the over operator, the composite 
pixel has the correct amount of fog, as shown by the region 130 in Fig. 4. Note that 
the upper left comer of the region 130 does not improperly contribute to the color of 
the region. 

Complex Geometry 

The method for simulating fog described above can be used in complex 
scenes with several layers of objects and fog. To illustrate the problem, it is helpful 
to consider an example showing how fog enclosing objects in a graphics scene can 
be modeled with fog layers. Fig. 5 illustrates an example of a scene with two objects 
A and B (150 and 152) and the surrounding fog between the viewpomt and the 
objects represented in fog layers (154-158). Object B at least partially covers Object 
B, and both objects have partially transparent regions. 

Each of the fog layers 1 54- 1 48 have a fog color F, and an amount of fog 
representing a portion of fog in 3D space. The background fog layer 154 has a fog 
amount of 1 since it extends from object A to infinity. Fog layer 156 has an amount 
of fog g, representing the amount of fog between objects A and B. Finally, fog layer 
158 has an amount of fog h, representing the amount of fog between object B and 
the viewpomt. The amount of fog between the viewpoint and object A is/ 

Consider that the amount of fog,/ is defmed as follows: 
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1 - / = = e^^-B-^A-n) ^ ^"^B^-n^.s (1 _ _ 

The fog layers and objects can be rendered independently and composited 
into image layers to compute a final output image. Consider a scene with only 
object A in front of an opaque fog background (layer 1 54) of color F. An expression 
5 for an image layer representing a rendering of the fogged object A superimposed on 
the opaque fog background is: . 
(Fog layer of amount /and color F) over (A over F) =yF over (A over F). 

Since the over operator is associative, this expression can be rewritten as: 
(/F over A) over F. 

1 0 One problem with using the over operator in this manner is that the fogged 

image layer will have non-zero alpha values across the entire layer. Specifically, for 
values of ranging from 0 to 1, the fogged image layer will have alpha values 
ranging from/to 1 . Since the fog layers occupy the entire screen, the fogged image 
layer will occupy the entire screen also and have non-transparent alpha values at 

1 5 every pixel location. One way to avoid having non-zero alpha values at every pixel 
location in the screen is to set the alpha values of the fogged image layer to zero at 
every location where the object A is totally transparent, or m other words, where 

Another way to avoid this problem is to use the atop operator to compute the 
20 fogged pixel layer as set forth in the new fog model above : 
Fogged A =/^^ + (l-/)A. 

Before proceeding to the larger problem of complex scenes, it is usefiil to 
examine how the conventional and new fog models compare. Recall that the two 
fogged image calculations are: 

25 



yF + (l-/)A 
/i,F + (l-/)A 
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These fog models both give the same (correct) resuh when composited over F. These 
are just special cases of: 
i:F + (l-/)A 

which, when composited over the final background F gives 

^ (/iT + (l-/)A)overF = ^ + (l-/)A + {l-^-(l-/)^^}F 

= a + Ji^-^-(l-/K)F + (l-/)A 

Since the K terms cancel, any value for K will satisfy this expression when 
an object is composited over an opaque fog background. This observation can be 
expressed as the following identity: 
if F = 1 

10 

then (i:F + B)overF = BoverF 

Scenes with more than one object and layer of fog such as shown in Fig. 5 
present a more complex problem. Representing fog as image layers, ia layered 
graphics rendering system can compute the final image by using the over operator to 
combine image layers representing the objects and fog layers. For example, the fmal 
15 ima^e can be represented as: 

(HF over B over gF over A ) over F . 

To arrive at this expression, one can start by compositing the front four 

layers: 

hF over B over gF over A = ( AF + (1 - h)B) over(gF + (1 - g)A) 

= AF + (l-/7)B + {l-/i-(l-A)5,}(gF + (l-g)A) 
= (A + g-g/j-g(l-A)5JF + (l-A)B + (l-/i)(l-5„Xl-^)A 
20 The fog factor g can be eliminated by substituting an expression for g in 

terms of/ 

hF over B over gF over A = (/ - (/ - /i)5^ )F + (1 - A)B + ( 1 - 5^ )(1 - /) A 

This resiilt is then composited over the opaque fog background. Because of 
identity (1), the step of compositing this result over an opaque background (Fa) can 
25 be written as: 

(/iFover Bover gFover A)over F = ((1 - h)B + (1 - BJ{1 - /)A)overF , 
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It would be advantageous to find a new fog model of the fonn: 
(B foggedby h) over (A foggedby J) over F; 

where the "foggedby" operator is an image operator used to simulate 
the fog in between the view point and an object. The new method for simulating fog 
described above can be substituted for the "foggedby" operator as follows: 
(hF atop B) over (/F atop A) over F. 

This approach has a number of advantages. First, objects like A that are 
partially occluded by other objects (e.g., B ) are fogged using a fog layer having a 
fog amount/ the fog amount from the viewpoint all the way to A. Thus, the fog can 
be computed for A independently of B. In other words, the fog can be computed for 
A, without regard to whether another object overlapping A is present in the scene. 
Second, the fogged objects A and B caii be rendered to separate image layers and 
composited later to construct an output image. As a result, the graphics rendering 
system can approximate motion of fogged objects in x and y dimensions (in a plane 
at the same depth fi-om the viewpoint) without re-rendering the fogged layers. In 
addition, the rendering system can simulate the motion of an object in the z-direction 
(depth from the viewpoint) by rasterizing the layer that moves in the z-direction 
independently with new values for the amount of fog between the object and the 
viewpoint 

The expression for simulating fog on two objects A and B can be extended to 
an arbitrary number of layers of fogged objects. Fig. 6 extends the example in Fig. 5 
by adding another object C ( 1 70) with a fog layer 1 72 of amount/ hi front of C. Part 
of the scene, P (1 74), from Fig. 5 can be treated as a smgle unage layer since these 
portions of the scene are composited mto a layer as explamed above. The object C 
and the portion P are in front of an opaque fog background 154. 

The new fog layer/F and object C can be overlaid on the combined layer P 
using the over operator as follows: 
yF over Cover P = (jT + (1 - y)C)over P 

= yT + (l-/)C+{l-y-(i-/)Q}P 
= 7T + (l-y)C + (l-y)(l-CJP 
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In a general stack of objects, each object pixel A, B, C etc. will be multiplied 
by terms of the form ( 1 -Ca) for all of the objects in front of it, and by all the terms of 
form ( 1 -y) for each fog layer in front of it. 

The atop operator can also be used to combine layers of objects and fog as 
5 follows: 

(yFatopC)overP' =(yC„F + (l-y)C)overP' 

= yQF + (l-/)C+{l-yC„-(l-y)C„}P' 
= 7C,F + (1-/)C + (1-CJP' 

The methods using the over and the atop operator differ because they use a 
different amount of fog for each layer. In the first method, the over operator builds 
up net pixel color using individual fog slice amounts j\ h, and g by the nested 
10 products: 

+ (1 - y)C + (1 - y)(l - CJ { (1 - /i)B + (1 - A)(l - 5, ) {( 1 - g)X}] . 

In the second method, the atop operator builds the net pixel color using ro/a/ 
fog depth amounts y, k, m. These total fog amounts can be defined in terms of the 
slice amounts as: 

J fog from viewpoint to C 

15 A = l-(l-y)(l-A) fog from viewpoint to B 

/n = 1 - (1 - y)(l - h){l - g) fog from viewpoint to A 

The net product generated by the atop operator is then: 

yQF + (l.y)C + (l-CJ {(l-i)B + (l-5J {(l-m)A}) 

The use of the over and atop operators as described above to compute net 
20 pixel color from several layers of fog and objects obtains the same resuh, but the 

atop operator has some advantages. First, it is more convenient to use the atop 

operator because it uses the total amount of fog from the viewpoint to thie object. 

The total amount of fog is easier to compute and facilitates independent rendering of 

each fogged object, e.g., A, B, and C. In addition, the use of total fog amounts, 
25 instead of amoimts of slabs or slices of fog, is necessary in cases where the 

expression for the fog amount is such that the followmg identity no longer holds: 

(l-/) = (l-;i)(l-g). 





wo 99/49417 



PCT/US99/06484 



-15- 



10 



15 



20 



For example, this expression is true for the following- definitions of/ g, and 



A = l-e-"^ 

However, the identity might not be true for other fog expressions. Thus, the 
new model for simulating fog, which uses the total amount of fog fi-om the 
viewpoint to the object, is a more accurate and more general model for a variety of 
expressions for the fog amoxmt. 

Fire and Glow 

The new fog model using the atop operation is also accurate when used in 
conjunction with glowing objects. Glowing objects such as fire add brighmess to a 
pixel but do not affect its opacity, alpha. A glowing object can be simulated with 
glow pixels that have a zero alpha component and non-zero color components. The 
simple 'over' operator with 0 then becomes: 
AoverF = A-h(l-^^)F 



One design issue that results from adding glow pixels in this manner is that 
the resulting color valueis must fall within a range of the aUowable color values in 
the graphics rendering system. For example, in some systems, this range might be 
from 0 to 1 (or 0 to 255 for 8 bit color values). To address this issue, the rendering 
system clamps the color values such that they are limited to the predetermined range. 
The discussion below, describing how the fog model applies to glowing objects, 
explains how to use clamping. 

The expression for simulating a fogged, glowing object is: 



It might appear that having Aa'^O would give the wrong result because it 
removes the contribution of fog in front of the object A. However, the fog model 
does generate the correct result because of the identity: 




(/^F + (l-/)A)overF 



if F„=l 

then (AT + B)overF = BoverF 
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The fogged, glowing sprite has no fog color in it. For Aa= 0, the first term of 
the fog model is zero such that: 

(/1„F + (1-/)A) = (1-/)A 

When placed over the background color F, the proper amount of/ shows 
through to account for the fog color in front of A, i.e./F, as well as the amount of 
fog peeking through the fogged A, (l-J)F. That is, 

/Fover AoverF = (/F atop A) over F 

independently of any value for^^^. 

To demonstrate that the new fog model does not result in any errors due to 
clamping, consider an example of two pixels, each with one representative color 
component: 

C = [Q C„]; D^[D, D^] 

The expression for computing C over D on one of the color component and 
the alpha component can be written as: 

Cover D = [clamp(Q+(l-CJD,) Q +(1-CJZ?,] 

It is not necessary to clamp the alpha channel because it will always result in 
a value from 0 to 1, inclusive, if the original alpha values are in that range. A series 
of over operations should ideally be carried out using an extended range such that 
clamping can be deferred to the last possible operation. One technique using this 
approach is demonstrated in the first example below. 

Consider the three following cases for simulating glowing objects in fog 
using A = [4 0], F = [F, l]: 

1) 'over' evaluated front to back: (^F over A) over F . This can be evaluated as: 
yFoverA = [cIamp(yF,+(l-/H) /4.(l-/)0] 

=[/p;+(i-/H /] 
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The clamping operation can be avoided since its argument can never be 
greater than one. 

R over F = [clamp((yF, + (1 - f)A,) + {l-f}F,) / + (1 - /)l] 

= [clamp((l-/)4 + F,) l] 

This approach loses a minimal amount of information since the earlier clamp 
operation is unnecessary. 

2) 'over' evaluated back to ftont: ^over(AoverF) 

AoverF = [clamp(4+(l-0)Fj O+(l-0)l] 
= [clamp(4+/;) l] 

Note that the clamp is necessary here because the argunient to the clamp 
operation can be greater than 1 . 

yPover R = [clamp(/F, + (1 - /)clamp(^, + F,)) / + (1 ^ /)l] 
= [clamp(/F, + (1 - /)clamp(^, + F,)) l] 
This approach yields a different and arguably incorrect answer. 

3) 'atop' evaluated as: (/F atop A) over F 

/FatopA = [clamp(^,-0 + (l-/)^J O] 
= [(1-/H 0] 

The claiiip is not necessary here becatise the argument of the clamp operation 
cannot be greater than 1 . 

RoverF = [clamp((l-/)4+(l-0)F,) 0+(l-0)l] 
= [clamp((l-/H + F,) 1] 

This approach yields the correct result. 
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Graphics Rendering Systems 

Figure 7 and the following discussion are intended to provide a brief, general 
description of a suitable computing environment in which a software rendering 
system or the front end of special purpose graphics rendering hardware can be 
implemented. The methods for simulating fog can be incorporated into rendering 
systems designed for conunercially available graphics programmiiig environments 
such as the OpenGL programming language from Silicon Graphics Corp. or 
DirectSD from Microsoft Corp. 

In software rendering systems, the stages of the graphics rendering pipeline, 
including traversing the scene database (display traversal), transforming objects to 
the view space, and rasterizing objects (hidden surface removal, scan conversion, 
pixel blending, antialiasing, shading, fog, and texture mapping) are performed by 
software modules executing on a computer. Generally, these modules include 
routines, programs, components, data structures, etc. that perform particular tasks or 
implement particular abstract data types. The software that implements the 
rasterizer (including a fog applicator as detailed above) can be executed in a variety 
of computer system configurations, including multiprocessor systems, 
microprocessor-based or programmable consumer electronics, nmiicomputers, 
mainframe computers, and the like. The software for simulating fog can be 
implemented in a series of computer-executable instructions in the rasterizer. Main 
memory or video memory on a display controller caii be used to store intermediate 
pixel values. 

The graphics rendering system may be executed in distributed computing 
environments where tasks are performed by remote processing devices that are 
linked through a communications network. In a distributed computing environment, 
program modules may be located in both local and remote memory storage devices. 

Fig. 7 shows an example of a computer system for implementing a software 
rendering system. The computer system includes a conventional computer 220, 
including a processing unit 221 , a system memory 222, and a system bus 223 that 
couples various system components including the system memory to the processing 
unit 22 1 . The system bus may comprise any of several types of bus structures 



wo 99/49417 



PCTAJS99/06484 



-19. 

including a memory bus or memory controller, a peripheral bus, and a local bus 
using any of a variety of conventional bus architectures such as PCI, VESA, 
MicroChannel, ISA and EISA, to name a few. The system memory includes read 
only memory (ROM) 224 arid random access memory (RAM) 225. A basic 
5 input/output system 226 (BIOS), containing the basic routines that help to transfer 
information between elements within the personal computer 220, such as during 
start-up, is stored in ROM 224. The personal computer 220 further includes a hard 
disk drive 227, a magnetic disk drive 228, e:g., to read from or write to a removable 
disk 229, and an optical disk drive 230, e.g., for reading a CD-ROM disk 23 1 or to 

10 read from or write to other optical media. The hard disk drive 227, magnetic disk 
drive 228, and optical disk drive 230 are connected to the system bus 223 by a hard 
disk drive interface 232, a magnetic disk drive interface 233, and an optical drive 
interface 234, respectively. The drives and their associated computer-readable 
media provide nonvolatile storage of data, data structures, computer-executable 

1 5 instructions, etc. for the personal computer 220. Although the description of 

computer-readable media above refers to a hard disk, a removable magnetic disk and 
a CD, other types of media which are readable by a computer, such as magnetic 
cassettes, flash memory cards, digital video disks, Bernoulli cartridges, and the like, 
may also be used in this computing environment. 

20 A number of program modules may be stored in the drives and RAM 225, 

including an operating system 235, one or more application programs 236, other 
program modules 237, and program data 238. A user may enter commands and 
information into the personal computer 220 through a keyboard 240 and pointing 
device, such as a mouse 242. Other input devices (not shown) may include a 

25 microphone, joystick, game pad, satellite dish, scanner, or the like. These and other 
input devices are often connected to the processing unit 22 1 through a serial port 
interface 246 that is coupled to the system bus, but may be connected by other 
interfaces, such as a parallel port, game port or a universal serial bus (USB). A 
monitor 247 or other type of display device is also connected to the system bus 223 

30 via an interface, such as a video adapter 248. In addition to the monitor, personal 
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computers typically include other peripheral output devices (not shown), such as 
speakers and printers. 

The personal computer 220 may operate in a networked environment using 
logical connections to one or more remote computers, such as a remote computer 
5 249. The remote computer 249 may be a server, a router, a peer device or other 

common network node, and typically includes many or all of the elements described 
relative to the personal computer 220, although only a memory storage device 250 
has been illustrated in Fig. 7. The logical connections depicted in Fig. 7 include a 
local area network (LAN) 25 1 and a wide area network (WAN) 252. Such 

10 networking environments are commonplace in offices, enterprise-wide computer 
networks, intranets and the Internet. 

When used in a LAN networking environment, the personal computer 220 is 
connected to the local network 251 through a network interface or adapter 253. 
When used in a WAN networking environment, the personal computer 220 typically 

1 5 includes a modem 254 or other means for establishing communications over the 

wide area network 252, such as the Internet. The modem 254, which may be internal 
or external, is connected to the system bus 223 via the serial port interface 246. In a 
networked environment, program modules depicted relative to the personal 
computer 220, or portions of them, may be stored in the remote memory storage 

20 device. The network connections shown are just examples and other means of 
establishing a communications link between the computers may be used. 
Implementation of the Layered Graphics Rendering Pipeline 

As described above, the new fog model is particularly useful in a real time, 
layered graphics rendering pipeUne where fogged objects caii be rendered 

25 independently to fog layers and then composited to form an output image. One 
implementation of a layered graphics rendering pipeline is described in co-pending 
U.S. patent application no. 08/671,412 by Nathan P. Myhrvold, James T. Kajiya, 
Jerome E. Lengyel, and Russell Schick, entitled Method and System for Generating 
Images Using Gsprites, filed on June 27, 1996, which is hereby incorporated by 

30 reference. This particular rendering system can independently render objects or 
parts of objects in a scene to separate image layers called sprites. For convenience, 
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we describe the details of the architecture here. It should be noted that conventional 
rendering architectures can be adapted to emulate a layered graphics pipeline by 
rendering objects to separate layers and then using the pixel fill capacity of the 
rasterizer to composite intermediate pixel values in the image layers. 

Fig. 8 is a block diagram illustrating one possible implementation of a 
layered graphics rendering system 330. This implementation is designed to 
communicate with a host computer (such as the computer in Fig, 7) through a bus 
332. The architecture of the layered graphics system can also be designed such that 
the microprocessor of the host PC is used in place of the DSP 334. 

This particular implementation includes a DSP 334, tiler 336, shared 
memory 338, gsprite engine 340, compositing buffer 342, and digital-to-analog 
converter (DAC) 344. The bus 332 transfers rendering commands and data 
(polygons and rendering attributes) between the host and the DSP 334. In response 
to rendering commands from the host, the rendering system renders independent 
scene elements to sprites, combines the sprites into display images, and transfers the 
display images to a display device through the DAC 344. The independent scene 
elements are typically contiguous objects (e.g., a robot m a game) or parts of an 
object (e.g., the robot's arm). 

The shared memory 338 stores image processing commands and sprites in a 
specific sprite fdnnat called a gsprite (generalized sprite). Ih this implementation, 
the shared memory is used to store gsprite and texture data, DSP code and data, and 
buffers used to transfer data between processing subsystems. The shared memory 
3 16 shown here comprises 4 Mbytes of RAM, and is implemented using two 8-bit 
Ram bus channels. 

The DSP 334 is responsible for performing fix)nt end geometry processing, 
and sprite management. Specifically, the DSP performs front end geometry and 
lighting calculations used for 3-D graphics. This includes model and viewing 
transformations, clipping, and Ughting. The DSP also performs sprite management 
including 1) computing sprite transforms, 2) sorting geometry assigned to a sprite 
among 32x32 sample chunks; 3) tracking sprite motion through characteristic points 
on the object model rendered to a sprite; 4) computing afiFme wrarps to approximate 
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changes in position and lighting of previous renderings; 5) compiitihg the error of a 
warped image approximation; 6) and regulating rendering resbxirces by dynamically 
adjusting quality parameters of image layers. It is important to note that the 
functions of the preprocessor can also be implemented on the host processor, instead 
of using both the host processor and DSP. 

The architecture of the rendering system shown in Fig. 8 is relatively 
independent of the specific DSP. However, the DSP should preferably have 
significant floating point performance. Suitable DSPs include the MSP-1 from 
Samsung Semiconductor and TriMedia from Phillips Semiconductor. These specific 
DSPs are two examples of DSPs that provide sufficient floating point performance. 
The host processor can used in place of the DSP and interface directly with the tiler 
336 through the bus 332. 

The rendering system 330 shown in Fig. 8 manages image data in three 
different units: gsprites, chunks, and blocks. The system serially renders image 
layers in 32 x 32 sample chunks, to prepare an object for rendering to a sprite, the 
DSP divides a sprite into chunks and sorts geometry assigned to the sprite among the 
chunks. The DSP also computes a gsprite display Ust that lists the gsprites for an 
output image. This display list includes pointers to gsprites, and more specifically, 
to gsprite data structures called header blocks. The gsprite header block stores a 
number of attributes of a gsprite including gsprite width, height, and an affine 
transform defined in terms of a screen space parallelogram (it may be preferable to 
use a rectangle to reduce anisotropy of sprite samples). The gsprite header block 
also includes a list of its member chunks. This list is in the form of pointers to 
chunk control blocks. 

The DSP 334 sets up the gsprite header blocks and stores them in shared 
memory 3 1 6. The gsprite header block includes a header for storing various 
attributes of the gsprite and for keeping track of where related image data is stored in 
the shared memory. The data structure includes fields to store the size of the gsprite, 
to represent the edge equations for the screen edges of the gsprite, to maintain 2-D 
transform data, and other image attributes. 
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Chunk control blocks include per chunk and per block parameters. The per 
chunk parameters include compression parameters, pixel format, and whether the 
pixel data resides in memory managed in Memory Allocation Units (MAU) in linear 
memory. An MAU is a piece of shared memory used to allocate chunk memory. 
MAU managed memory includes a list of MAUs ( 124 bytes for example), each 
MAU having a pointer to the next MAU. In one specific implementatioh for 
example, the chunk control blocks are stored in sequential MAUs for each gsprite. 

The per block parameters include the number of MAUs the block spans, and 
a block pointer pointing to the first byte of pixel data for the block. The specific 
block format is an 8 x 8 x 4 array of pixels that encode 32 bit pixels (8 bits for RGB 
and Alpha). 

The tiler 336 performs scan-conversion, shading, texturing, hidden-surface 
removal, anti-aliasing, translucency, shadowing, and blending for multi-pass 
rendering. Preferably the tiler is implemented as a VLSI chip along with the gsprite 
engine 340. The tiler rasterizes polygons one chxmk at a time in a serial fashion to 
compute pixel firagments. The pixel fragments include translucent and partially 
covered pixels. In cases where a primitive partially covers a pixel location modeled 
as 4 X 4 array of sub-pixel regions, the tiler computes the pixel coverage and stores it 
in a mask which indicates which sub-pixel regions are covered. The tiler performs 
hidden surface removal using a z-buffer approach on pixelis. It saves the firontmost 
opaque pixel and any translucent or partially covered pixels in front of the opaque 
pixel. 

The tiler has a double buffered rasterization buffer so that it can compute 
sprite samples m one buffer, while resolving pixel fi-agments for samples in the 
second buffer. The rasterization buffer includes two 32 x 32 color buffers for double 
buffering color values of fiilly covered opaque pixels in the current chunk, a depth 
buffer for storing depth values for the pixels in the color buffer, and a fiagment 
buffer for storing color, depth, and coverage masks for partially transparent pixels. 
The tiler composites the firagments and fiilly covered pixel at pixel locations within a 
chunk to compute a rendered gsprite chunk, a 32 x 32 chunk of pixels in a sprite 
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image layer. The tiler stores the resulting rendered gsprite chunks in the shared 
memory. 

The tiler has fog logic used to modify color values calculateid by the scan 
conversion engine (rasterizer) within the tiler. The scan conversion engine scans 
primitives (e.g., triangles) and interpolates attributes at vertices to generate pixel 
coverage and interpolated color values. The scan conversion engine also computes 
the fog factor /for each pixel. The pixel values and associated fog factor/generated 
by the scan conversion engine are stored in a queue for further processing. A fog 
applicator implements a fog model as described above to apply fog (of amount/and 
color F) to each calculated pixel. The output of the fog applicator is transferred to a 
pixel input processor, which performs depth compare and blending operations to 
determine how the incoming pixel values should be stored in the rasterization buffer. 
Once all the primitives in a chunk are rasterized, a pixel output processor resolves 
the pixel fragments for pixels in the chunk. 

The process of resolving pixel fragments includes taking a depth sorted list 
of fragments for each pixel location in a chunk and comjDositing them along with the 
front-most opaque pixel at the pixel location. The pixel output processor sorts the 
fragments and then uses the opacity and coverage mask to compute the contribution 
of each fragment to the final pixel color of the ou^ut pixel in the sprite. The 
resolved pixels have RGB color and alpha components. 

The gsprite engine 340 operates at video rates to address the gsprite chimk 
data and perform the necessary image processing for general affine transformations 
(which include scaling, translation vwth subpixel accuracy, rotation, reflection and 
shearing). The gsprite engine can be implemented on the same or a different chip 
from the tiler 336. If on a separate chip, it interfaces with a memory interface unit in 
the tiler to access the gsprite data structures in shared memory. 

The gsprite engine 340 mcludes a video timing generator which controls 
video display refresh, and generates the timing signals necessary to control gsprite 
accesses. To display each frame, the gsprite engine 340 traverses the gsprite display 
data structures to determine which sprites need to be read for any given 32-scanline 
band. For each gsprite in a band, the gsprite engine reaids the header block, clips the 
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sprite to the current display band, and places the sprite in the sprite queue for 
rasterization. The gsprite engine scans each sprite based on the specified affine 
transform in the gsprite header and generates read requests. To hide the latency of 
sprite accesses, the gsprite engine utiUzes a caching scheme that pre- fetches and 
5 caches sprite blocks in a cache memory before a rasterizer computes transformed 
sprite samples using the cached data. 

A simple rasterizer in the gsprite engine scans each sprite based on the 
specified affine transform in the gsprite header and calculates the filter parameters 
for each pixel. The gsprite engine uses a filter to map color and alpha data at sample 

10 locations in gsprite space to screen space. Specifically, it applies either a 

2 X 2 or 4 by 4 filter kernel to compute pixel values (color or both color and alpha) at 
pixel locations in screen space. 

The gsprite engine has a compositing buffer control for controlling the 
operation of a compositing buffer. The compositing buffer control passes 

1 5 transformed sprite samples and instructions on how to combine samples from 
different layers. The compositing buffer control monitors a ready line from the 
compositing buffer 342 to ensure that the gsprite engine 340 does not overrun the 
compositing buffer 342. 

Gsprite chunk data is processed a number of scan lines at a time for display. 

20 In one implementation, chunk data is processed 32 scan lines at a time. This 
implementation of the compositing buffer (342) includes two 32 scan line color 
buffers which are toggled between display and compositing activities, the 
compositing buffer also includes a 32 scaii line alpha buffer which is used to 
accumulate alpha for each pixel. This particular compositing buffer has compositing 

25 logic that implements the over image operator. The compositing logic receives 
transformed sprite samples, and combines them with the accumulated color values 
using the alpha values from the alpha buffers. 

The DAC 344 includes a R G B video DAC and corresponding video port 
346, to video editing devices. Individual components can be used to implement the 

30 functionality of the DAC. The DAC 344 implements the basic functions that are 
common to most RAMDACs on the market today. The DAC includes logic for 
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reading and writing internal control registers, and for pipelining the video control 
signals. The DAC includes pixel data routing logic that controls the routing of pixel 
data from the compositing buffers. In the normal operating mode, this data is passed 
at pixel rates to Color LUTs for each of the three channels. The DAC also has a 
5 clock generator that generates the video clock. These clocks are generated by two 
phase locked clock generators to eliminate synchronization drift. 
Using the Fog Model on Sprites 

While the fog model described above applies to a variety of rendering 
architectures, it is particularly useful in rendering architectures where objects can be 

10 rendered to separate image layers or "sprites." In such systems, the new fog model 
has implications in two parts of the rendering pipeline: 1) in the tiler, where it is 
used to generate fogged pixels in a sprite using the atop operator; and 2) in the sprite 
compositor, where it facilitates compositing of sprites representing fogged objects 
using the over operator. In the layered architecture described above, the tiler 

1 5 performs the first computation, and the gsprite engine controls the second 

computation in conjunction with the compositing buffers, which combine sprites 
using the over operator. 

Generating Sprites 

To generate fogged sprite pixels, a rendering system applies fog of color F 
20 and an amount corresponding to the fog influence from the viewpoint to the surface 
being rendered. 

Given the parameters: 
fog amount = / 
fog color = F = [F, 1] 
polygon color = A = [^^ A^] 

The fogged sprite color should be: 
/FatopA = /l,F + (l-/)A 

= [A.7^-h(l-/H 4] 

The components within the tiler for making this computation are explained 
further above. In summary, the fog applicator implements logic to perform this 
calculation using the fog color F, pixel color and alpha A, and fog amount/ 
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Compositing Operations on Fog Sprites 

In a layered graphics pipeline, the rasterizer can apply fog to each object 
independently as it renders the object to a sprite layer. The compositing buffer can 
then be used to composite fogged object layers and the opaque fog background 
5 layer. 

Given two objects embedded in fog, the expression for fogging the scene can 
be factored into a series fogged image layers combined with the over operator: 
( AF atop B ) overC/F atop A) over F 

Each fogged surface can be placed in a separate sprite: 

sprite 1 =/iFatopB 
10 sprite 2 = ^atopA 
sprite 3 = F 

Each of the objects can move in (x,y) directions m the scene without re- 
rendering. If an object moves in the z direction, this object can be rendered 
independently to a new sprite layer, without re-rendering the other fogged objects in 
separate sprites. The non-changing (or imperceptibly changing) sprites can retain 
1 5 their original color values for more than one frame in an animation sequence. To 
compute each ou^ut image, the rendering system can composite the separate layers, 
including both re-used and/or re-rendered fog layers, using the over unage operator. 

Conclusion 

While the invention is explained with reference to a specific rendering 
20 architecture, it is important to emphasize that it can be employed in a variety of 
graphics rendering architectures, whether they implement a frame buffer or a 
chunking architecture as described above. The fog model applies to a layered 
graphics pipeline and more conventional rendering pipeline where all geometry is 
rendered to a single output image, rather than independent layers. The precise logic 
25 or software instructions used to implement the fog model can vary as well. 

In view of the many possible embodiments to which the principles of my 
invention may be applied, it should be recognized that the illustrated embodhrient is 
only an example of the invention and should not be taken as a limitation on the 
scope of the invention. Rather, the scope of the invention is defined by the 
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following claims. I therefore claim as rny invention all that comes within the scope 
and spirit of these claims. 
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We claim: 

1 . In a graphics rendering system for generating an output image from a 3D 
graphics scene having a viewpoint and graphical object models, a method for 
simulating fog in the 3D graphics scene, comprising: 

for a pixel rasterized for an object in the 3D graphics scene, computing an 
amount of fog / of color F between the viewpoint and the object; 

applying the amount of fog /between the viewpoint and the object to the 
pixel using an atop image operator; and 

repeating the above steps for additional pixels rasterized for the object to 
compute an image simulating the object in fog. 

2. The method of claim 1 wherein the pixel values each have color and 
opacity components and the step of applying the amount of fog comprises: 

multiplying each of the color and opacity components of the new color 
values generated for the pixel by a factor (1-/) to compute a first intermediate result, 
where/is a dissolve factor representing an amount of fog between the viewpoint in 
the scene and pixel depth of the pixel; 

multipljdng color components of a fog color value F by the opacity 
component of the pixel, and by the dissolve factor /to compute a second 
intermediate result; and 

adding the first and second intenriediate results to compute a fogged pbceL 

3. The method of claim 1 fiuther including repeating the steps for a second 
object and compositing the pixels resulting from applying fog to each of the objects 
to compute an image simulating the objects in fog. 

4. The method of claim 3 including separately computing fogged image 
layers representing fogged pixels of the objects; and compositing the fogged image 
layers using an over image operator to compute a composite hnage. 



wo 99/49417 



PCT/US99/06484 



-30- 

5. The method claim 1 wherein the method computes each fogged pixel 
accordmg to the following expression, yp atop A; 

where/is the amount of fog, F is fog color, and A is a color of the pixel 
being fogged. 

6. The method of clgimi 1 including computing fogged image layers for 
objects in the graphics scene using an atop image operator to compute each of the 
fogged image layers; and 

combining each of the fogged image layers into an output image using an 
over image operator to combine the fogged image layers. 

7. The method of clsiim 1 including independently computing fogged image 
layers for objects in the graphics scene; and approximating motion of a moving 
object in the scene in an (x,y) plane relative to a viewpoint of the scene by moving a 
fogged image layer representing the moving object in the (x,y) plane. 

8. The niethod of claim 1 including: 

simulating motion of a moving object in the scene in a z-direction relative to 
the viewpoint of the scene by rendering the moving obj ect, including fogging the 
pixels of the moving object with a iiew fog amoxmt, to compute a fogged image layer 
representing the moving object; 

re-using a previously computed fogged image layer by compositing the 
fogged image layer representing the moving object with tiie previously computed 
fogged layer to compute an output image. 

9. The method of claim 1 wherein the object is a glowing object, having 
pixels with zero alpha components and non-zero color components, and wherein fog 
is applied to the glowing object according to the following formula: 

(/F atop A) over F. 
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10. The method of claim 1 wherein at least two fogged pixels from different 
objects at a pixel location are combined according to the following formula: 

(hF atop B) over (/F atop A) over F, 

where A and B are pixel color values from the different objects and pixel B is 
in front of pixel A relative to the viewpoint, h is an amount of fog from the 
viewpoint to pixel B, and /is an amount of fog from the viewpoint to pixel A. 

1 1 . The method of claim 10 wherein more than two pixels from different 
objects at a pixel location are fogged according to an expression (xF atop X) where 
X are color values of an object and jc is an amount of fog from the viewpoint to pixel 
X; and wherein the fogged pixels are combined using the over operator. 

12. A computer-readable medium having computer executable instructions 
for performing the steps of claim 1 . • 

13. In a graphics rendering system for generating an output image from a 3D 
graphics scene, logic for applying fog to a pixel comprising an atop image operator 
for applying an amount of fog /between the viewpoint and an object and color F to 
the pixel having at least one color value and an opacity value. 

14. The logic of claim 13 further including: 

a rasterizer for computing pixel color, opacity and depth values for pixel 
locations in a view space from geometric primitives in the object, for computing tiie 
amount of fog/ arid for communicating the pixel color and opacity values and the 
amount of fog /to the atop image operator. 

15. The logic of claim 13 wherein the atop iinage operator comprises: 

a first multiplier for multiplying the amount of fog/ and opacity of the pbcel 
to compute /4 a; 

a second multiplier for multiplying/i a and a fog color F to compute/4aF; 
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a third multiplier for multiplying (l-J) and pixel color A to compute (1-/)A; 

and 

an adder for adding the results of the second and third multipliers to compute 
a fogged pixel. 

16. The logic of claim 13 further including an over image operator in 
communication with the adder for compositing a fogged pixel with a pixel generated 
from a different object. 



10 17. A method for simulating fog in a graphics scene comprising: 

rendering objects in the scene to separate image layers, including applying an 
amount of fog of a predetermined color to pixels in each image layer; and 

computing an output image by compositing the separate, fogged image layers 
with an over image operator. 

15 

18. The method of claim 17 wherein the step of rendering the objects 
includes applying an amount of fog between a viewpoint and each respective object 
using the atop image operator, 

20 1 9. A graphics rendering system including a fog mode for applying fog to 

pixels to sinixilate fog, comprising: 

a rasterizer for computing pixel color, opacity and depth values for pixel 
locations in a view space from geometric primitives in the object, and for computing 
an amount of fog /between a viewpoint and an object surface of an object being 

25 rendered; 

a fog applicator for applying the amount of fog of a predetermined color to 
rasterized pixels from the rasterizer using an atop image operator; and 

a compositor for compositing fogged pixels from different objects togetiier to 
compute a composite pixel value. 

30 
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20. The rendering system of claim 19 wherein the rasterizer and fog 
applicator are operable to compute fogged image layers independently; and 

wherein the compositor is operable to combine independently rendered 
fogged image layers to form an output image for display. 
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